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PREFACE 

The  5th  Weather  Wing  originally  intended  to  publish  this  report,  but  because  of 
its  wide  applicability  to  Air  Weather  Service  (AWS)  detachments,  USAFETAC  is  pub- 
lishing it  as  a Technical  Note. 
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MODEL  OUTPUT  STATISTICS  FORECAST  GUIDANCE 


Introduction 

The  National  Weather  Service  (NWS)  Model  Output  Statistics  (MOS)  Final  Forecast 
Guidance  is  now  available  on  COMET  III  for  selected  US  cities.  Some  of  the  cities 
are  near  enough  to  AWS  forecasting  units  that  the  MOS  data  for  the  cities  are  useful 
for  detachment  forecasting  purposes.  Forecast  outputs  from  the  NWS  Limited  Fine 
Mesh  Model  (LFM),  Primitive  Equation  Model  (PE),  and  Trajectory  Model,  along  with 
surface  observations  from  0500  GMT  and  1700  GMT  are  used  in  the  MDS  approach  to  pro- 
duce probability  forecasts  of  precipitation,  frozen  precipitation,  clouds,  ceilings, 
visibilities,  and  direct  forecasts  of  wind  speed  and  direction. 

Since  the  information  in  the  MOS  bulletins  needs  no  adaptation  and  is  immediately 
useable,  it  can  be  particularly  important  to  AWS  forecasters  who  have  become  increas- 
ingly concerned  with  "doing  more  with  less."  Unlike  other  forecast  aids,  it  does 
not  require  the  forecaster  to  build  a data  base  and  then  develop  correlations  between 
forecast  parameters  and  observed  weather  elements.  The  information  in  the  bulletin 
is  directly  applicable,  starting  from  the  first  day  it  is  received.  But  even  more 
important,  the  guidance  in  the  MOS  bulletins  tells  the  forecaster  explicitly  what  he 
needs  to  know:  the  likelihood  of  precipitation,  the  type  of  precipitation,  the  most 

likely  ceiling  and  visibility,  and  the  wind  direction  and  speed.  In  "Bulletin 
Description,"  below,  an  outline  is  given  of  the  type  of  information  contained  in  the 
bulletins,  and  in  the  "interpretation  and  Application"  section,  guidance  is  provided 
on  how  the  information  can  be  used. 

Bulletin  Description 

The  Forecast  Guidance  Bulletin  is  prepared  twice  daily,  based  primarily  on  0000 
GMT  and  1200  GMT  data.  Forecasts  are  valid  12,  18,  24,  36,  42,  and  48  hours  after 
data  base  time.  A final  probability  of  precipitation  forecast  is  valid  60  hours 
after  data  base  time.  Bulletin  contents  are  as  follows: 

a.  POP  06.  The  first  line  in  the  bulletin  is  labeled  POP  06.  The  four  numbers 
on  this  line  are  forecasts  of  the  probability  of  precipitation  for  6-hour  periods 
with  the  first  number  representing  the  probability  for  the  period  ending  18  hours 
after  data  base  time.  The  forecast  is  valid  for  a 6-hour  time  period  ending  at  the 
time  indicated  on  the  bulletin.  For  example,  a POP  06  forecast  of  "2"  valid  at 
31/06Z  (see  example  bulletin  on  Appendix  A),  indicates  there  is  a 2 % chance  of  pre- 
cipitation during  the  00Z  to  06Z  period.  Forecasts  are  made  through  36  hours  after 
data  base  time.  In  making  POP  forecasts,  the  conterminous  United  States  is  divided 
into  various  areas  depending  on  the  season.  Regionalized  equations  based  on  past 
model  output  are  then  derived  for  these  areas  and  applied  to  different  inputs  at  each 
station. 

b.  POP  12.  The  second  line  of  the  bulletin  is  labeled  POP  12.  Four  forecasts 
of  precipitation  probability  for  12-hour  periods  are  given  with  the  first  number 
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representing  the  probability  for  the  period  ending  24  hour  after  data  base  time. 

The  forecast  is  valid  for  a 12-hour  time  period  ending  at  the  time  indicated  on  the 
bulletin.  For  example,  a POP  12  forecast  of  "20"  valid  at  31/12Z  means  there  is  a 
20#  chance  of  precipitation  from  00Z  to  12Z  (see  Appendix  A).  Forecasts  are  pro- 
vided through  60  hours  after  data  base  time.  Occasionally,  an  inconsistency  occurs 
in  the  POP  06  and  POP  12  forecasts  when  one  or  the  other  of  the  two  6-hour  POPs 
exceeds  the  associated  12-hour  POP.  The  reason  this  sometimes  happens  is  that  the 
6-  and  12-hour  MOS  POP  equations  were  developed  independently.  The  6-hour  POPs 
should  be  used  in  a relative  sense  to  determine  the  more  likely  6-hour  period  for 
precipitation  within  the  inclusive  12-hour  period.  As  of  publication  date,  the  NWS 
Technique  Development  Laboratory  (TDL)  is  working  to  correct  this  problem. 

c.  POF.  The  third  line  is  labeled  POF.  Conditional  probabilities  of  frozen 
precipitation  are  presented  through  48  hours  after  data  base  time.  These  forecasts 
are  valid  at  the  time  indicated  on  the  bulletin  (as  opposed  to  the  POP  which  is 
valid  for  a 6-  or  12-hour  period).  For  example,  a POF  forecast  of  "10"  valid  at 
31/00Z  would  mean  there  is  a 10#  chancv  of  precipitation  being  frozen  _if  precipita- 
tion occurs.  In  developing  forecast  equations  for  POF,  the  United  States  is  not 
divided  into  regions  as  with  POP,  but  rather  a combination  of  single  station  and 
generalized  operator  approaches  is  used.  All  developmental  data  for  the  United 
States  is  pooled  together,  but  50#  values  of  thickness  and  temperatures  are  also  used 
at  each  station  to  produce  the  probability  of  frozen  percipltation. 

d.  CLDS.  The  fourth  line  is  labeled  CLDS.  Probabilities  of  the  occurrence  of 
fuur  categories  of  cloud  cover  are  forecast  through  48  hours.  The  forecasts  here 
are  for  general  cloud  cover  and  not  any  specific  cloud  heights.  Forecasts  are  valid 
at  the  time  indicated  on  the  bulletin.  Probabilities  are  given  in  tens  of  percent 
for  the  categories  below.  The  four  numbers  representing  the  four  categories  are 
printed  on  the  bulletin  from  left  to  right  for  each  forecast  time. 

Category  1 - Clear,  thin  scatter,  thin  broken,  thin  overcast 

Category  2 - Scattered 

Category  3 - Broken  ^ 

Category  4 - Overcast,  obscured 

The  four  probability  figures  are  followed  by  a slash  (/)  and  a fifth  number  (not  a 
probability)  which  indicates  which  category  is  the  "best"  forecast  category,  i.e.. 
Category  1,  2,  3j  or  4.  For  example,  a cloud  forecast  of  0127/4  valid  at  31/00Z 
means  there  is  a 0#  chance  of  Category  1 sky  cover,  a 10#  chance  of  Category  2,  a 
20#  chance  of  Category  3>  and  a 70#  chance  of  Category  4,  while  the  "best"  category 
forecast  is  Category  4.  The  percentages  are  rounded  to  the  nearest  ten  percent,  so 
probabilities  will  not  always  sum  to  100.  An  exception  to  this  is  that  84#  is  trans- 
mitted as  a "9".  When  a forecast  is  missing,  the  group  9999/9  will  be  transmitted. 
The  single-station  approach  is  used  in  developing  equations  for  this  forecast.  Each 
station  has  a set  of  equations  which  changes  with  the  season. 
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e.  CIG.  The  fifth  line  is  labeled  CIG  and  contains  probability  forecasts  for 
the  occurrence  of  each  of  five  ceiling  categories  through  30  hours  after  data  base 
time.  The  categories  are  defined  in  paragraph  f,  below.  Probabilities  are  listed 
in  tens  of  percent  as  with  CLDS,  but  for  CIG  and  VIS  there  are  five  categories  rather 
than  four.  As  with  the  CLDS  forecast,  the  "best"  category  follows  the  slash  (/). 

For  example,  a CIG  forecast  of  01225/4  valid  at  31/00Z  means  there  is  a 0$  chance  of 
ceiling  Category  1,  a 10#  chance  of  Category  2,  a 20#  chance  of  Category  3,  a 20# 
chance  of  Category  4,  and  a 50#  chance  of  Category  5,  while  the  "best"  category  fore- 
cast is  Category  4.  Different  programs  are  used  for  the  CLDS  and  CIG  forecasts. 

This  results  in  infrequent  inconsistencies  which  NWS  TDL  is  working  to  correct. 
Regionalized  equations  are  used  for  both  CIG  and  VIS  forecasts. 


f.  VIS . The  sixth  line  is  labeled  VIS  and  contains  forecasts  of  the  probabili- 
ties of  the  occurrence  of  each  of  five  visibility  categories  through  30  hours  after 
data  base  time.  The  format  is  the  same  as  for  CIG  forecasts.  The  categories  for 
CIG  and  VIS  are: 


6- 


CIG 

VIS 

Category 

1 

<200 

ft 

<1/2  NM 

Category 

2 

200 

to  < 500 

ft 

1/2  to  <1  NM 

Category 

3 

500 

to  <1000 

ft 

1 to  <3  NM 

Category 

4 

1000 

to  <2000 

ft 

3 to  <5  NM 

Category 

5 

>2000 

ft 

>5  NM 

WIND.  The 

seventh  line  is  labeled 

WIND  and  contains  < 

speed  (knots)  and  direction  (tens  of  degrees)  through  48  hours  after  data  base  time. 
These  are  not  probability  forecasts.  The  standard  "ddff"  format  is  used.  The  wind- 
speed  forecast  does  not  include  gusts.  Forecasts  are  valid  at  the  time  indicated 
on  the  bulletin.  Single-station  equations  are  used  to  produce  the  wind  forecasts. 


Interpretation  and  Application 

This  section  provides  general  comments  on  how  the  forecast  guidance  may  be  inter- 
preted and  a specific  example  of  its  application. 

a.  At  present,  only  NWS  locations  are  used  as  end  points  for  the  guidance  bulle- 
tin. There  are  tentative  plans  to  include  some  AWS  locations  at  a future  date. 

The  M0S  method  involves  archiving  output  from  numerical  models  and  matching  this  out- 
put with  observations  of  local  weather.  Forecast  equations  are  then  derived  using  a 
variety  of  statistical  techniques.  Numerical  model  bias,  as  well  as  local  climatology, 
are  automatically  built  into  this  system. 


b.  There  are  no  specific  rules  for  determining  when  an  AWS  detachment  is  "close 
enough"  to  a NWS  end  point  to  use  the  forecast  guidance.  When  the  weather  at  the  NWS 
end  point  is  representative  of  weather  at  a nearby  AWS  detachment,  the  guidance  can 
be  used.  Whether  or  not  the  city  guidance  is  useful  for  the  nearby  detachment  will 
vary  with  both  the  synoptic  situation  and  time  of  year,  and  will  depend  on  local 
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effects  and  direction  of  the  mean  flow  (see  Appendix  B).  Even  when  weather  at  the 
two  points  (NWS  and  AWS)  is  not  similar,  the  guidance  may  still  be  used  if  some  rela- 
tionship is  known.  For  example,  an  upstream  end-point  station  may  be  known  to  pick 
up  stratus  a few  hours  earlier  or  at  a height  which  is  a few  hundred  feet  lower  than 
a down-stream  AWS  location. 

c.  In  order  to  use  the  forecast  information,  forecasters  must  know  how  to  inter- 
pret the  probabilities.  The  category  with  the  highest  probability  may  be  selected  as 
the  categorical  forecast,  or  the  "best"  category  may  be  selected.  The  "best"  cate- 
gory is  not  necessary  the  one  with  the  highest  probability.  The  "best"  category  is 
arrived  at  for  the  CLDS  forecast  by  a method  NWS  calls  "Inflation-Minimum  Bias,"  and 
for  the  CIG  and  VIS  forecasts  through  use  of  a "NWS  Scoring  Matrix."  Briefly,  these 
methods  involve  altering  the  original  probability  forecasts  to  either  produce  favor- 
able bias  (number  of  forecasts  divided  by  number  of  observations),  or  to  emphasize  a 
forecast  of  certain  categories  over  others.  The  best  way  for  AWS  forecasters  to  use 
the  probabilities  at  this  time  is  to  use  a method  similar  to  that  used  with  condi- 
tional climatology  tables.  That  is,  add  the  probabilities  from  left  to  right  and 
forecast  that  category  where  the  total  first  equals  or  exceeds  50$.  For  example, 
with  a CIG  forecast  of  01225/4,  Category  4 would  be  forecast  because  the  probabili- 
ties sum  to  50$  (0+ 10+20+20)  in  Category  4.  In  this  example,  the  "best"  category  is 
also  Category  4,  but  the  category  with  the  highest  probability  (50$)  is  Category  5- 
This  "conditional  climatology  method"  (summation)  is  the  method  suggested  for  deter- 
mining a categorical  forecast.  A comparison  of  the  three  methods  for  determining  a 
categorical  forecast,  i.e.,  1)  highest  probability,  2)  "best"  category,  or  3)  50$ 
method,  may  prove  interesting  for  forecasters.  If  two  or  three  of  the  methods  pro- 
duce the  same  categorical  forecast,  the  forecaster  can  have  increased  confidence  in 
the  forecast. 

d.  At  some  time  in  the  future,  when  customer  "utility  matrices"  have  been  devel- 
oped, these  probabilities  can  be  multiplied  by  values  in  the  utility  matrix.  A cate- 
gorical forecast  can  then  be  made  based  upon  both  the  forecast  probabilities  and  each 
particular  customer's  needs  represented  by  his  utility  matrix.  Tf  customers  are 
being  supplied  probability  forecasts,  they  might  want  to  know  not  only  what  ceiling 
and  visibility  are  expected,  but  also  what  the  likelihood  is  of  lower  conditions. 

This  information  is  provided  in  the  forecast  guidance  and  can  be  passed  to  customers 
if  the  forecaster  agrees  with  the  guidance. 

e.  Plotting  the  data  in  the  bulletin,  as  illustrated  in  Appendix  C,  simplifies 
presentation  of  the  information  and  helps  organize  forecast  reasoning.  A graphic 
display  of  the  bulletin  information  also  provides  an  excellent  shift-change  briefing 
aid.  The  oncoming  forecaster  can  quickly  check  the  plotted  forecast  guidance  and  be 
prepared  to  answer  that  first  phone  call  asking,  "What's  it  going  to  be  like  tomor- 
row?" The  headings  can  be  typed  on  an  appropriate  general  purpose  worksheet  and 
information  written  on  an  acetate  overlay  or  a local  form  can  be  prepared.  In  the 
example,  POP  06,  POP  12,  and  POF  have  been  copied  directly  from  the  bulletin  shown  in 
Appendix  A.  The  CLDS  and  WIND  figures  have  been  combined  into  a one-line  presenta- 
tion in  Appendix  B,  and  CIG  and  VIS  have  been  copied  directly  (don't  forget  to  add  a 
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zero  to  CIG  and  VIS  figures).  Inclement  weather  periods  may  be  emphasized  by  1)  shad- 
ing in  green  POP  06  and  POP  12  greater  than  50$,  2)  shading  in  blue  POF  greater  than 
50$,  3)  connecting  the  50$  probabilities  in  each  ceiling  and  visibility  category  with 
a dashed  black  line,  4)  circling  the  "best"  category  for  each  time  period,  and  5) 
shading  in  red  when  probabilities  sum  to  30$  in  the  lowest  two  categories.  Both  12Z 
and  00Z  bulletins  can  be  plotted  on  the  same  worksheet  (see  Appendix  C).  This  sim- 
plifies comparisons  of  forecasts  for  the  same  valid  time  and  highlights  major  changes 
which  the  models  have  picked  up  in  the  intervening  12  hours. 

f.  The  following  forecast  applications  have  been  noted  during  verification  of 
the  FOUS  6 KNKA  bulletin  for  Norfolk,  VA  (ORF).  The  list  is  not  all-inclusive  and 
other  applications  may  be  developed  for  other  locations. 

(1)  The  50$  category  should  usually  be  the  one  selected  as  the  forecast. 
However,  if  probabilities  are  "shifting"  to  the  lower  categories,  e.g.,  from  00118/5 
to  11116/5  in  consecutive  forecast  periods,  the  forecaster  should  look  to  other  aids 
and  thoroughly  evaluate  the  possibility  of  forecasting  a lower  category. 

(2)  Forecasts  of  Norfolk  wind  direction  and  speed  have  been  excellent  for 
Langley.  Forecasts  of  winds  with  westerly  components  have  been  particularly  good  in 
both  speed  and  direction.  The  guidance,  however,  has  been  typically  six  hours  slow 
in  picking  up  winds  shifting  to  an  easterly  direction,  but  easterly  component  wind 
speeds  have  been  good.  Gradient  gusts  have  been  accurately  forecast  by  multiplying 
the  forecast  wind  speed  by  1.4. 

(3)  A rapid  increase  in  probability  of  precipitation  (e.g.,  from  5 to  50$ 
or  30  to  70$)  over  a 6-  or  12-hour  period  is  a good  indicator  of  precipitation  in 
the  second  period. 

g.  The  following  applications  are  general  in  nature: 

(1)  For  purposes  of  interpreting  POF:  snow,  ice  pellets,  snow  grains,  etc., 

are  considered  frozen  precipitation;  mixed  precipitation  is  not  included  in  the  fore- 
cast; freezing  rain  is  considered  liquid  precipitation. 

(2)  POF  is  the  probability  of  frozen  precipitation  based  on  the  assumption 
that  precipitation  will  occur.  If  the  forecaster  is  confident  that  precipitation 
will  occur,  he  can  use  the  POF  figure  directly  as  forecast  in  the  bulletin.  If  the 
forecaster  is  not  entirely  confident  that  precipitation  will  occur,  probability  of 
frozen  precipitation  is  given  by  the  product  of  the  POF  times  the  POP  (e.g., 

. 10x.50= .05=5$) . The  POP  06  should  be  used  in  this  formula  for  periods  through  36 
hours . 

(3)  Category  1 is  the  same  as  AWS  Category  G.  For  ceiling  only,  the  sum  of 
the  probabilities  of  Categories  2 and  3 is  the  probability  of  AWS  Category  I. 

Conclusion 

The  M0S  Forecast  Guidance  bulletin  provides  computed  forecast  information  for 
many  US  cities  that  is  useful  for  some  AWS  f recast  units.  Appendix  D contains  a 
list  of  NWS  end  points.  Those  marked  with  an  asterisk  are  available  via  COMET  III 
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at  the  time  of  this  publication.  The  forecasts  are  primarily  in  probabilistic  terms 
and  are  based  on  correlations  of  the  output  of  MS  models  with  actual  observed 
weather.  The  MOS  guidance  offers  no  panacea  for  forecasters,  but  it  does  contain 
valuable  forecast  information  in  a compact  form  that  should  be  considered  by  all 
units  close  to  a city  for  which  data  are  available. 
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Appendix  A 


Example  Forecast  Guidance  Bulletins 
(Norfolk,  Virginia) 


30/1200Z  Mar  7 6 


P0US6  knka 

31/00Z 

3 1/06 Z 

31/12Z 

31/18Z 

01/00Z 

01/06 Z 

01/12Z  02/00Z 

ORF  P0P06 

2 

20 

50 

80 

P0P12 

20 

90 

60/40 

POF 

0 

0 

0 

0 

0 

0 

0 

CLDS 

0127/4 

1117/4 

0118/4 

0118/4 

0119/4 

0019/4 

1117/4 

CIG 

01225/4 

11115/5 

12213/3 

02322/3 

VIS 

00118/5 

00216/5 

11322/3 

11323/3 

WIND 

1504 

1603 

1205 

1009 

0810 

3417 

3220 

31/0000Z  Mar  76 


F0US6  knka 

31/12Z 

31/18Z 

01/00Z 

01/06Z 

01/12Z 

01/18Z 

02/00Z  02/12Z 

ORF  P0P06 

30 

70 

100 

60 

P0P12 

70 

100 

60/30 

POF 

0 

0 

0 

0 

0 

0 

0 

CLDS 

0018/4 

1018/4 

0109/4 

0019/4 

1019/4 

2126/4 

2116/4 

CIG 

11323/3 

01225/4 

01116/5 

12213/2 

VIS 

00225/4 

11215/4 

00226/5 

11224/3 

WIND 

1406 

1507 

1410 

2013 

2114 

2515 

3214 
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Appendix  B 

OBJECTIVE  VERIFICATION  OF  FORECAST  GUIDANCE 


For  forecasters  who  desire  an  analytic  answer  to  the  question,  "How  good  is  this 
product  for  ray  station?",  the  following  procedure  is  suggested: 

1.  Choose  the  category  which  is  closest  to  an  important  operational  threshold 
for  your  station,  e.g..  Category  3,  ceiling  less  than  1000  feet. 

2.  Choose  a forecast  period — 12  or  l8  hours  after  data  base  time. 

3.  Record  the  forecast  probabilities  for  ceiling  less  than  1000  feet  (sum  of 
probabilities  for  Categories  1,  2,  and  3)  from  the  00Z  or  12Z  data  base  on  a work- 
sheet as  illustrated  below. 


4.  Record  opposite  each  forecast,  whether  or  not  a ceiling  less  than  1000  feet 
occurred. 


Month 

Day 

Fcst 

Probability 

CIG  <1000 

1 

20 

Yes 

2 

20 

No 

3 

10 

No 

4 

0 

No 

5 

0 

No 

5. 

At  the  end  of 

the  test  period  (2  or 

3 months  or  more 

forecast 

reliability 

graph. 

The  test  period 

should  include 

only  winter  (Oct-Mar)  data.  Do  not  include  data  from  both  summer  and  winter  equa- 
tions . 


6.  Opposite  each  forecast  probability,  plot  the  observed  percent  correct.  For 
example,  if  there  were  40  forecasts  of  20%  probability  of  which  10  occurred,  the 
point  plotted  would  have  "Y"  coordinate  20$  and  "X"  coordinate  10/40  = .25  = 25$. 
Perfect  reliability  is  represented  by  the  straight  line  where  "x"  and  "Y"  coordinates 
are  equal. 

7.  In  order  to  judge  how  significant  departures  from  perfect  reliability  are, 
the  distribution  of  forecast  probabilities  can  also  be  graphed.  Then,  for  example, 
if  the  least  reliable  forecast  is  found  to  be  that  for  a probability  of  40$,  but 
40$  is  forecast  only  1$  of  the  time,  the  deviation  is  not  significant. 
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LIST  OF  TECHNICAL  NOTES 

Number  Title  Date 

74-1  Atmospheric  Moisture  Parameterization  (AD-784814)  Jan  74 

74-2  Development  of  a Gridded  Data  Base  ( ) Apr  74 

(Publication  delayed) 

74-3  A Precipitating  Convective  Cloud  Model  (ADA-002117)  May  74 

74- 4  A Synoptic -Sc ale  Model  for  Simulating  Condensed  Atmospheric  Jun  74 

Moisture  (ADA-002118) 

75- 1  Estimated  Improvement  in  Forecasts  of  the  SANBAR  Hurricane  Jan  75 

Model  Using  the  Airborne  Weather  Reconnaissance  System 
(ADA-004097) 

75-2  Spring  Weather  Patterns  of  the  Western  United  States  Mar  75 

(Reprints)  (ADA-OO669I) 

75-3  Summer  Weather  Patterns  of  the  Western  United  States  May  75 

(Reprints)  (ADA-OO986O) 

75-4  Autumn  Weather  Patterns  of  the  Western  United  States  Jul  75 

(Reprints)  (ADA-013801) 

75- 6  Winter  Weather  Patterns  of  the  Western  United  States  Sep  75 

(Reprints)  (Publication  delayed) 

76- 1  Listing  of  Seminars  Available  at  Hq  AWS,  AWS  Wings,  and  Mar  76 

AFGWC  (Publication  delayed) 

76-2  Some  Aspects  of  Estimating  the  Probability  of  Cloud-Free  Mar  76 

Lines -of -Sight  in  Synamic  Situations  ( ) 

76-3  Model  Output  Statistics  Forecast  Guidance  ( ) Sep  76 


f 

, .pfsciFf 


RUN*'-' 


HOT 


